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Title: Apparatus, Systems and Methods for 
Packet Based Transmission of Multiple Data Signals 

Field of the Invention 

[0001] This invention relates to systems for transmitting and distributing audio 
5 data, video data and other types of data. 

Background of the Invention 

[0002] Recent advances in video monitor technology have resulted in the 
development of large format, high quality video displays that are capable of displaying 
multiple video signals simultaneously. In television studios and other locations 
10 where many different video sources must be monitored, these video displays have 
begun to displace traditional individual monitors that displayed a single video source 
to which they were physically coupled. 

[0003] Modern signal processing equipment allows video and other data to be 
routed to different display monitors, however, this equipment can still require that for a 

15 particular signal to be used in multiple locations on multiple display devices it must 
be replicated and coupled to equipment in the different locations. This results in 
excessive cabling requirements, multiple signal regeneration and replication stages, 
and can result in degraded signals and multiple failure points within the signal path. 
[0004] There is a need for an improved efficient system for receiving various 

20 input signals, including video, audio and data signals, formatting the received signals 
and routing the formatted signals to various output devices. 

Summary of the Invention 

[0005] In one embodiment, the present invention provides a system that 
includes a master controller, one or more input processors, one or more output 
25 processors, and one or more user controllers. The system may also include 
additional master controllers that serve as back-up master controllers. 
[0006] One or more input devices are coupled, directly or indirectly, to each of 
the input processors. Each input device provides one or more input signals to the 
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input processors. One or more output devices are coupled to the output processors. 
Each output device receives an output signal from an output device. Each of the input 
processors generates one or more packetized signals. Each packetized signal is 
transported across a communications link to one or more of the output processors. 
5 Each output processor may receive one or more packetized signals. 

[0007] The master controller receives user control signals from one or more 
user controllers indicating which input signals are to be routed to which output 
devices. The user control signals may also indicate the format in which the input 
signal is to be presented at the output device. 

10 [0008] For example, for a video input signal the user control signals may specify 
the position and dimensions of a window on an output display device in which the 
input video signal is to be displayed. The user control signals may also define other 
characteristics for the displayed video signal, such as color balance, white balance, 
color to black & white conversion or the addition of a border or any other 

15 characteristics that a video signal may be processed to have. 

[0009] For an audio input, the user control signals may specify a particular 
equalization (ie. jazz, rock, classical), volume balancing to some specified maximum 
or average volume, left - right signal balance, encoding in or conversion to a particular 
noise reduction and/or a multi-channel audio standard. For a data signal, the user 

20 controls may specify characteristics that are appropriate to the data. 

[0010] In response to the user control signals, the master controller generates 
input processor control signals to operate the input processors and output processor 
control signals to operate the output processors. The input and output processor 
control signals may be transmitted to the various input and output processors using 

25 any type of communications link. The master controller coordinates the operations of 
the various input and output processors (and other elements of the system) to provide 
the output signals requested by a user or users who operate the user controllers to 
generate the user control signals. 

[0011] If the system includes more than one master controller, one of the 
30 master controllers may be designated as a primary master controller and the 

remaining master controllers designated as backup master controllers. Each of the 
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master controllers is coupled to the user controllers to receive the user control 
signals and is capable of generating the input processor control signals and the 
output processor control signals. The primary master controller actively generates the 
input processor control signals and output processor control signals. If the master 
5 controller fails or is disabled for any reason, one of the backup master controllers may 
be designated as the primary master controller. 

[0012] Each input processor has an input processor local controller which 
receives the input processor control signals for that input processor. In response to 
the input processor control signals, the input processor local controller configures the 
10 various components of the input processor to receive and process the input signals 
coupled to that input processor and to generate one or more packetized signals, as 
requested by the master controller 

[0013] Each input processor includes a plurality of data buffers to store each 
input signal in a digital form. If an input signal is received in an analog form, an 

15 analog-to-digital converter is dynamically coupled between an input port at which the 
input signal is received and a data buffer to digitize the signal. Some input signals 
may be received in a processed manner, meaning that the signal has been 
processed in some manner. If an input signal is received in a processed manner 
then an un-processor may be dynamically coupled between an input port at which the 

20 input signal is received and a data buffer in which the input signal is stored. 

Additionally each input processor may include one or more data analyzers that can be 
dynamically coupled to each input signal to provide information about the input signal. 
The resulting information is also stored in a data buffer. The buffered signals are 
then read out and processed by signal processors to format them as indicated by the 

25 user control signals. The processed signals are also buffered in data buffers. Each 
input signal may be processed multiple times to create different versions of the input 
signal, to extract various information regarding the input signal for use on different 
output devices, or for use on the same output device in different versions, formats or 
sizes. 

30 [0014] The data buffers in the input processor, the output processor and other 
components and embodiments of the invention are used to temporarily store data that 
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is received from a source and is subsequently read out by one or more recipient or 
destination elements or devices. Data may be read out in the order in which it is 
received, in which case a first-in/first-out buffer may be used to store the data. 
Altematively, the data may be read out in any order by the recipient elements. In each 
5 case, the data buffer is configured to retain any datum until it has been read by all 
recipient elements that use the datum. 

[0015] Each of the buffered signals (including the input signals and the 
processed signals) is assigned a global Identification code. One or more of the 
buffered signals are converted Into a packetized signal by a packetized signal output 

10 stage in each Input processor. Each packetized signal contains a series of packets. 
Each packet contains a part of the data from the buffered signal along with the global 
identification code of the buffered signal. An input processor may have more than one 
packetized signal output stages to produce more than packetized signal. 
[0016] A packetized signal may be converted into and transmitted as a 

15 bitstream, or It may be transmitted using any communications protocol. 

[0017] Each output processor receives one or more packetized signals. Each 
packetized signal is buffered as it is received. As complete packets corresponding to 
each global identification code are received, they are assigned a local identification 
code and are buffered in a separate data buffer. The isolated packets in data buffer 

20 correspond to a particular version of an Input signal received at one of the input 

processors. The isolated stream may be processed to reverse any signal processing 
step or steps applied in the input processor or in an input device or combination of 
devices that combine to produce an input signal coupled to the input processor, such 
as a data compression step, or to apply additional signal processing steps. Any such 

25 processed signal is buffered again and assigned a new local identification code. 
One or more these buffered signals is then combined to form each output signal. 
[0018] In one embodiment of the Invention, a packet router is coupled between 
a plurality of input processors and a plurality of output processors. The packet router 
receives packetized signals from the input processors and isolates the packets 

30 corresponding to each global identification code. The packetized router then 

assembles new packetized signals corresponding to a combination of the global 
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identification codes. The pacl<etized router operates under the control of the master 
controller to route packets with the appropriate global identification code to the 
appropriate output processor. The packet router allows an input signal received at 
any of the input processors to be formatted and routed to any of the output 
5 processors. 

[0019] In another embodiment of a packet router according to the invention, 
packets from one or more incoming packetlzed signals are stored in packet storage 
locations within a memory system. The packets are then read by one or more 
packetized signal output stages, each of which produces an outgoing packetized 

10 signal corresponding to a selected set of global identification codes. Storage of 
incoming packets and distribution of the packets to the packetized signal output 
stages is controlled by a router controller. In another embodiment of a packet router, 
one or more signal processors, such as video scalers or delay elements, are 
provided to process the incoming packets to provide processed packets that form a 

15 processed signal. Each processed signal is assigned a unique global identification 
code and may be included in an outgoing packetized signal. 
[0020] These and other aspects of the invention and its various embodiments 
are described in greater details below. 

Brief Description of the Drawings 

20 [0021] Several exemplary embodiments of the present invention will now be 
described in detail with reference to the drawings, in which: 

Figure 1 illustrates a system according to the present invention; 
Figure 2 illustrates a first input processor according to the present invention; 
Figure 3 illustrates the display of a first video monitor; 
25 Figure 4 illustrates the display of a second video monitor; 

Figure 5 illustrates one form of a packetized signal according to the present 
invention; 

Figure 6 illustrates a first output processor according to the present invention; 
Figure 7 illustrates a second input processor according to the present 
30 invention; 
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Figure 8 illustrates a second output processor according to the present 
invention; 

Figure 9 illustrates an exemplary coupling between a plurality of input 
processors and a plurality of output processors; 
5 Figure 10 illustrates a first packet router according to the present invention; 

Figure 11 illustrates a second packet router according to the present invention; 
Figure 12 illustrates a third packet router according to the present invention; 
Figure 13 illustrates an alternative output stage for an output processor 
according to the present invention; and 
10 Figure 14 illustrates a switch for use with the alternate output stage of Figure 

13. 

Detailed Description of Exemplary Embodiments 

[0022] Reference is first made to Figure 1 , which illustrates a signal processing 
system 100. The signal processing system includes a master controller 102, an 

15 input processor 104 and an output processor 106 according to the present invention. 
The input processor 104 receives a plurality of input signals 110 from various signal 
sources 108 and provides a packetized signal 112. The packetized signal 112 
corresponds to some or all of the input signals 110 or to data or processed signals 
derived from the input signals. The packetized signal 112 is transported by a 

20 communications link 186 to the output processor 106. The output processor 106 
receives the packetized signal 112 and produces one or more output signals 114, 
which are processed by output devices 116. The output signals 114 correspond, at 
least in part, to one or more of the input signals 110. 

[0023] The system may additionally include backup master controllers (not 
25 shown). 

[0024] The input processor 104 and output processor 106 operate under the 
control of the master controller 102. The master controller 102 is coupled to one or 
more user controllers 118, from which the master controller receives user control 
signals 119. The master controller 102 and the user controllers 118 may be 
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combined in a single unit, or may be assembled in a single assembly, or they may be 
separate units that are coupled together. 

[0025] A user or multiple users (not shown) human or some other type of 
device (for example automated monitoring and control systems) operate the user 
5 controllers 118 to generate the user control signals 119. The user control signals 
119 indicate which input signals or signals derived from the input signals 110 the 
user would like included in the output signal 114 provided to each output device. 
Each user may have control over one or more output devices 1 16 in whole or in part. 
The user control signals 119 may also indicate additional characteristics about the 

1 0 output signal 114 provided to each output device 116. The master controller 1 02 

translates the users control signals 119 into input processor control signals 120 and 
output processor control signals 121 to control the operation of the input processor 
104 and the output processor 106 respectively so that the output signals 1 14 are 
provided in accordance with the user control signals 119. 

15 [0026] The input signals 110 may be base-band, compressed, time division 
multiplexed audio signals, video signals (which may also include audio information), 
metadata, or other data signals. Similarly, the output signals 1 14 may be audio 
signals, video signals, or data signals. Typically, each output signal 1 14 will 
correspond to one or more of the input signals and or information derived from the 

20 input signal. A particular output signal may include a combination of audio, video or 
data input signals or signals produced by input signal analyzers or any combination of 
these types of signals. The nature of each output signal 1 14 is appropriate for the 
output device 116 that receives the output signal 1 14. Some of the output devices 116 
may be video monitors, such as analog video monitor 116a and digital video monitor 

25 1 16b, for displaying output video signals. Some of the output devices 1 16 may be 
sound systems, such as sound amplification and broadcast system 116c, for further 
processing or playing output audio signals. Some of the output devices may be data 
processing systems, such as computer system 116d, for further processing or 
displaying the output data signals. In any particular embodiment of the present 

30 invention, the output signals 116 may be of the same or different types, depending on 
the usage of the embodiment. In an alternative embodiment of the invention, the 
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output processor may provide only a single output signal. The type of any particular 
signal may change depending on the usage of the signal, under the control of the 
master controller 102. 

[0027] Reference is next made to Figure 2, which illustrates the input processor 
5 104 in greater detail. Input processor 104 includes a plurality of input ports 123, a 
plurality of input signal analyzers or processors, such as A/D converter 150, a plurality 
of data buffers 124, which are part of a memory system 122, one or more signal 
processors 126, a packetized signal output stage 127, a packetized signal output port 
138 and an input processor local controller 140. The packetized signal output stage 
10 127 includes a packetized signal formatter 128, a packetized signal buffer 130 and a 
packetized signal generator 132. 

[0028] Memory system 122 may be a local memory device or memory space 
within the input processor 104 or it may be located on an attached storage device or 
other medium. Data buffers 124 will typically comprise memory space allocated 

15 within memory system 120. 

[0029] The input processor local controller 140 receives the input processor 
control signals 120. The input processor local controller 140 controls the operation of 
the various elements of the input processor 104 through control lines 142 in 
response to the input processor control signals 120. 

20 [0030] Each input signal 1 10 is coupled to one of the input ports 123. Each of 
the input ports 123 is coupled to the memory system 122. Each input signal 110 is 
buffered in a data buffer 124 in memory system 122. Analog input signals 110 are 
converted to a digital version and the digital version is buffered in a data buffer 124. 
For example, if input signal 110c is an analog input signal, then an analog-to-digital 

25 (A/D) converter 150 is dynamically coupled between input port 1 10c and memory 

system 122 to convert input signal 110c into a corresponding signal 110c' comprising 
a stream of packets according to a digital signal standard. For example, if input 
signal 110c is a standard 1V peak-to-peak audio signal, it may be sampled and 
converted by A/D converter 150 into a WAV digital audio signal IIOc', as is commonly 

30 done to record music on CD-ROM media. For example, if input signal 110c is a 
compressed video stream a de-compressor (one of the signal processors) may be 
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dynamically coupled between input port 110c and memory system 122 to convert 
input signal 110c into a corresponding signal 110c* comprising a stream of data 
according to a digital signal standard. 

[0031] In the present embodiment, the input processor contains a bank of AID 
5 converters, each of which may dynamically be coupled between any of the input ports 
123 (or a group of the input ports) and memory system 122. The input processor 
local controller 140 controls the coupling of any particular A/D converter between any 
particular input port 123 and memory space 122. A particular A/D converter 150 may 
be shared by two or more input ports 123 under the control of input processor local 

10 controller 140. Alternatively, a dedicated A/D converter 150 may be provided for some 
or all of the input ports 123. The A/D converter 150 may be activated by the input 
process local controller 140 if the input signal 110 received at a port 123 is an analog 
signal. In another alternative embodiment, some or all of the input ports 123 may be 
designated as analog input ports and an A/D converter may be permanently coupled 

15 between those ports and the memory system 122. 

[0032] The input ports may be any type of communication port, such as an 
Ethernet, BNC. optical, telephone line or any port suitable with any type of 
communication system. The input signals may be in any communication standard or 
protocol, including, including TCP/IP. In this case, the coupling between the input 

20 device and the processor may be a LAN, WAN, the Internet or another TCP/IP 
communication system. 

[0033] The input processor 104 may also contain a bank of input signal 
analyzers (not shown). The input signal analyzers may be dynamically or statically 
coupled to an input port in the same manner as A/D converter 150. For example if the 

25 input signal is a video signal, an input signal analyzer may extract performance and 
signal content metrics from or about the input signal such as blackness of the signal, 
the amount of motion within the signal, bit or formatting errors in the signal. The 
metadata produced by the the data analyzer is stored in a data buffer and is 
considered and treated as a processed signal that can be packetized and coupled to 

30 the output processor over a communication link. 



-9- 



[0034] Each of the input signals 110 may be retrieved from the corresponding 
data buffer 124 as a buffered signal 156. 

[0035] The input processor may also include other input signal processing 
elements that may be coupled between an input port 123 and memory system 122. 
5 The signal processing elements may include video scalers, video de-interlacers, data 
compressors, data de-compressors, data format converters or any other type of 
signal processor, including the signal processing elements described below. For 
example, if one of the input signals is an analog NTSC video signal, then a video 
signal digitizer may be dynamically coupled between an input port at which the signal 

10 is received to convert the input signal into a MPEG2 digital video signal. The input 
processor may contain a bank of input signal processing elements and analyzers, 
which may be dynamically coupled between any input port and memory system 122. 
Input processing elements or analyzers may also (or alternatively) be coupled to only 
one port for selective use with that port. Input processing elements may also (or 

15 alternatively) be permanently coupled to one or more of the input ports. 

[0036] The signal processors 126 are coupled to memory system 122 to 
retrieve the buffered signals 156 from memory system 122, process the buffered data 
signals to generated processed signals 158, which are then buffered in data buffers 
124 in memory system 122. A processed signal 158 is stored in a different data 

20 buffer 124 than the input signal 110 from which the processed signal is derived. The 
signal processors 126 are illustrated in a dotted box and the coupling between the 
memory system 122 and the signal processor extends to the dotted box to indicate 
that any of the signal processors may be dynamically coupled to any of the data 
buffers 124 to retrieve a buffered signal and to store a processed signal. 

25 [0037] A particular input signal 110 may be processed to generate more than 
one processed signal 158 and each of the resulting processed signals 158 are 
stored in different data buffers 124 in memory system 122. As a result, the original 
input signal 110 and any versions of the original input signal 110 that are generated 
as processed signals 158 are available from memory system 122 as buffered 

30 signals 156. 
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[0038] In the present embodiment the signal processors 126 include video 
scalers, embedded audio extractors, ancillary data extractors, signal content 
analysers 160 and data compressors 164. The signal processors 126 may also 
include data de-compressors, image rotation devices, special effects processors, 
5 image inverters, spatial filters, edge enhancement processors, color space 

converters, audio sweetening processors, digital audio decompressors, and digital 
audio processors. A signal processor may be used to process two or more input 
signals (or processed signals) by time-division-multiplexing the signal processor 
between the data buffers used to buffer the two or more input signal (or processed 
10 signals). 

[0039] Each video input signal 110 will have height and width dimensions, 
usually defined in pixels. For example, a video image may comprise a series of 
frames that are 640 pixels wide by 400 pixels high. A video scaler 160 is capable of 
rescaling a video signal from its original dimensions to different dimensions. In the 

15 present embodiment, the input processor 104 includes a plurality or bank of video 
scalers 160. Each video scaler 160 receives control instructions from the input 
processor local controller 140 to extract a particular video input signal 110 from the 
appropriate data buffer 124 and rescale the video input scale to specified dimensions 
and to store the resulting processed signal 158 in another data buffer 124. A video 

20 scaler 160 may be configured to retain or change the aspect ratio of an input data 

signal or to crop the input data signal in the processed signal and to provide any other 
function that a conventional scaler is capable of providing. For example, a video 
scaler may be configured to crop the input data signal to select a portion of it, and then 
scale the cropped video image to specified dimensions. 

25 [0040] A particular video scaler 160 may be instructed to scale a video input 
signal 110 to more than one set of new dimensions and may generate two or more 
processed signals 158, each of which is separately buffered in separate data buffers 
124. In addition, a particular video scaler 160 may be shared (or multiplexed) 
between two or more video input signals 1 10 to generate two or more corresponding 

30 processed signals 158, each of which is separately buffered in separate data buffers 
124. One video input signal 110 may also be retrieved by two or more video scalers 
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160 (or other signal processors 126) to produce two or more corresponding 
processed signals 158, which are similarly buffered in separate data buffers 124. 
[0041] Data compressors 164 are used to generate a processed signal 158 
that is a compressed version of any signal stored in a data buffer 124. For example a 
5 video input signal 110 in a DVI format may be compressed into an MPEG-2 format to 
reduce the amount of data required to transmit the signal. The resulting MPEG-2 
format video signal is stored in a data buffer 124 as a processed signal 158. The 
data compressors 164 may include a plurality of compression elements, which may 
be hardware or software elements, designed to compress audio, video or data 

1 0 signals into various types of compressed signals. The data compressors may 

provide a lossy or lossless compression. In each case, the compressed data signal 
produced by a data compressor 164 is stored as a processed signal 158. A 
particular embodiment of an input processor 104 may include any number and type of 
data compressors 164. 

15 [0042] The data compressors 164 may include horizontal or vertical line filters 
that produce a processed video data signal comprising a portion of the video data 
from a video input data signal. For example, a horizontal line filter may be configured 
to horizontally compress a 640 x 400 pixel video signal into a 320 x 400 pixel video 
signal by discarding every other pixel in each line of the video signal. A vertical line 

20 filter may be configured to compress a 640 x 400 pixel video signal into a 320 x 400 
discarding every other line in the video signal. A horizontal/vertical line filter may be 
configured to compress a 640 x 400 video signal into a 160 x 100 video signal by 
discarding three of every four lines of the video signal and discarding three of every 
four pixels in each line that is retained. 

25 [0043] The input signals 110 will typically be asynchronous with respect to one 
another (unless they are from a synchronized source). The size and timing of packets 
in each input signal will depend on the signal standard used to encode the signal. 
For example, input signal 1 10a may be formed of uniformly sized packets that are 
spaced equally apart in time. Input signal 1 10b may be formed of differently sized 

30 packets that do not arrive at equally spaced intervals. As a result of the differences 
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between the input signals 110, data buffers 124 may be allocated with a large or 
smaller memory space to properly buffer each input signal 110. 
[0044] In addition, the size and timing of packets in processed signals 158 may 
also vary depending on the data standard used to encode the processed signals 158. 
5 The data buffers 124 used to buffer a processed signal 158 may similarly be 
dynamically allocated a memory space of a suitable size. 

[0045] The master controller 102 (Figure 1) controls the operation of the input 
processor 104. The master controller 102 assigns a unique global identification code 
. . .to each signal that is buffered in a data buffer 124. This global identification code is 

10 used to identify the signal in both the input processor and the output processor. Each 
version of a particular input signal 110 that Is buffered in a data buffer 124 is assigned 
a different global identification code. For example, video input signal 1 10a is first 
buffered in the form in which it is received. The input signal 110a may be scaled to 
new dimensions using a video scaler 160 to produce a scaled signal llOaa, which is 

15 separately buffered. The input signal 1 10a may also be scaled to a second set of 
dimensions to produce a second scaled signal llOab, which is also separately 
buffered. The second scaled signal 110ab may then be compressed to produce a 
scaled and compressed signal 110ac, which is also separately buffered. Each of the 
different versions 110a, llOaa, llOab, 110ac may be separately retrieved from its 

20 data buffer and may be identified using its unique global identification code. 
[0046] To further explain the invention and the present embodiment, an 
example of the use of this embodiment will be described. In the example, the input 
processor 104 receives three digital video input signals 110a, 110b and llOd and 
one analog video input signal llOe. Analog video input signal llOe is digitized using 

25 a A/D converter 150 to produce a digital signal llOe' corresponding to analog signal 
llOe. Signals 110a, 110b, 110c and llOe' are buffered in separate data buffers 124. 
[0047] Reference is made to Figure 3, which illustrates output device 116a, 
which is an analog standard definition 4:3 format video monitor capable of displaying 
images with a resolution of 640 x 480 pixels. The display of video monitor 116a is 

30 used to display information in five different parts or windows: video windows 170, 172, 
174 and 175 and graphics window 178. 
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[0048] A user configures the video and other information shown on each video 
monitor using user controller 118. User controller 118 may provide a graphical or 
other interface allowing the user to define windows and other elements on a video 
monitor and assign specific input signals or other information to be displayed in each 
5 window or other element. The user has defined the parts of the display on video 
monitor 116a as follows: 



Window / Element 


Position 


Dimensions 


Contents 




(relative to too 
left corner) 






Video window 170 


10, 10 


400 X 300 


A version of video 
input signal 110a 


Video window 172 


420, 10 


200 X 113 


A version of video 
input signal 110b 


Video window 174 


460, 340 


160 X 120 


A version of video 
input signal llOd 


Video window 176 


10, 320 


440 X 140 


Rejected packets 
data for video signal 
110b 


Graphics window 
178 


420, 160 


200x150 


Date / Time / 

Metadata 

Information 



[0049] Reference is made to Figure 4, which illustrates output device 116b, 
10 which is a digital high definition 16:9 format video monitor with a resolution of 1920 x 
1080 pixels. The display of video monitor 116b is used to display information in three 
different parts or windows: video windows 180, 182 and 184. The user has defined 
the parts of the display on display monitor 116b as follows: 



Window /Element 


Position 


Dimensions 


Contents 




(relative to too 
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left comer) 






Video window 180 


60 60 


1140 X 640 


A \/pr^ion nf x/iHpo 

input signal 110b 


Video window 182 


1280, 60 


560 X 420 


A version of video 
input signal 1iOe 


Video window 184 


1280, 540 


610x460 


A version of video 
input signal 110a 



[0050] In an alternate example, window positions maybe such that some or all 
of the windows are overlapping, or arranged in a cascaded manner. 
[0051] The video windows have been described as containing "a version of 
5 one of the video input signals 110. The user will typically specify the position and 
dimension of a window on a video monitor and the input signal 110 that the user 
would like displayed in each window. An appropriate version of the input signal is 
prepared by the input processor 104 and provided to the output processor 104 for 
display on the video monitor. Alternatively, the user may specify certain signal 

10 processing steps to be performed on an input signal before it is displayed in a 

window. For example, if the signal processors 126 (Figure 2) include a color / black & 
white converter, then a user may specify that a color input signal be converted into a 
black & white signal and that the black & white version of the input signal (or a version 
of the black & white signal) be displayed in a particular window. 

15 [0052] Reference is again made to Figure 1. The user controller 106 transmits 
the user's instructions for each output device 116 to the master controller as user 
control signals 119. The user's instructions relating each output device 116 will 
typically depend on the nature of the output device 1 16. For example, if an output 
device 116 is an audio processing system capable of receiving and switching 

20 between multiple audio signals, then the user may specify that one or more audio 
input signals 110, or the audio components of video input signals 110, be directed to 
the sound output device 116. If an output device 1 16 is only capable of receiving a 
single audio signal and then amplifying and broadcasting the audio signal, the user 
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may specify that a particular Input audio signal or the audio component of a particular 
video input signal 110 be directed to the sound output device 116. Similarly, a user 
may specify that any particular output device 1 16 can receive any combination of 
information that the output device is capable of receiving. 
5 [0053] Referring again to Figure 3, the windows 176 and 178 contain 
information that is not present in any input signal 110. The user controller Is 
configured to allow the user to select any information that may be generated within 
system 100 and which is suitable for a particular display device. The rejected packets 
information displayed in video window 176 may be determined by a signal analyzer 
10 (not shown) that analyzes input signal 1 10b to determine the number of defective 
packets received as part of the input signal 1 10b. The signal analyzer is one of the 
signal processors 126. The signal analyzer then generates a video signal Illustrating 
this information in a standard video signal fomiat and stores the video signal in a data 
buffer 124 as a processed signal 158. 
15 [0054] In response to the user control signals 119, the master controller 

transmits input processor control signals 120 to the input processor local controller 
140 indicating the final version of each input signal 110 that will be required by the 
output processor 106 to produce the output signals 1 14 for the output devices 116. 
For each required version, the master controller 102 also indicates the top left pixel at 
20 which that version will be displayed. 

[0055] For the example input signals 110 and output video monitors 116 
described above, the master controller instructs the input processor to prepare the 
following signals: 

i. 400 X 300 pixel scaled version of video input signal 1 10a; 
25 ii. 610 X 460 pixel scaled version of video input signal 1 10a; 

ill. 200 X 1 1 3 pixel scaled version of video input signal 1 1 0b; 
Iv. 1 140 X 640 pixel scaled version of video input signal 1 10b; 
V. 160 X 120 pixel scaled version of video input signal 1 10d; 
vi. 560 X 420 pixel scaled version of video input signal 11 Oe; and 
30 vii. 440 x 140 pixel video image illustrating rejected packet information for 

video signal 110b. 
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[0056] The master controller 102 does not instruct the input processor to 
produce a signal showing the date, time and analyzed information, which is required 
for graphics window 178 on video monitor 116a. This signal is produced in the output 
processor and is described below. 
5 [0057] In response to the input processor control signals 120, the input 

processor local controller 140 determines how the required the versions of each input 
signal 110 can be produced and configures and couples the input ports 123, A/D 
converters 150, data buffers 124 and signal processors 126 produce the required 
versions of each input signal. As described above, every signal stored in a data buffer 
10 124 is assigned a unique global identification code. 

[0058] In the present example, the input processor local controller 140 
configures the Input processor 104 as follows: 

i. Store input signal 110a In data buffer 124a. Assign global identification 
code G101 to the stored signal. 
15 ii. Store input signal 110b in data buffer 124b. Assign global identification 

code G102 to the stored signal. 
Hi. Store input signal llOd in data buffer 124c. Assign global identification 

code G103 to the stored signal. 
Iv. Couple an A/D converter 150 between input port 108e at which input 
20 signal 110e is received to produce a digital version llOe' of input signal 

110e. Store digital signal 110e' in data buffer 124e. Assign global 
identification code G104 to the stored signal. 
V. Couple video scaler 160a to memory system 122 to retrieve signal G101 
and produce a scaled version of 400 x 300 pixel scaled version of signal 
25 G101. The scaled version is stored In data buffer 124f and is assigned 

global identification code G105. 
vi. Couple video scaler 160b to memory system 122 to retrieve signal G101 
and produce a 610 x 460 pixel scaled version of signal G101. The 
scaled version is stored in data buffer 124g and is assigned global 
30 identification code G106. 
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vii. Couple video scaler 160c to memory system 122 to retrieve signal G102 
and produce a 200 x 113 pixel scaled version of signal G102. The 
scaled version is stored in a memory buffer 124h and is assigned global 
identification code G107. 
5 viii. Couple video scaler 160d to memory system 122 to retrieve signal G102 

and produce an 1 140 x 640 pixel scaled version of signal G102. The 
scaled version is stored in data buffer 124i and is assigned global 
identification code G108. 
ix. Couple video scaler 160e to memory system 122 to retrieve signal G103 
10 and produce a 160 x 120 pixel scaled version of signal G103. The 

scaled version is stored in data buffer 124j and is assigned global 
identification code G109. 
X Couple video scaler 160e to memory system 122 to retrieve signal G104 
and produce a 560 x 420 pixel scaled version of signal G104. The 
15 scaled version is stored in data buffer 124k and is assigned global 

identification code G110. 

xi. Couple a signal analyzer (one of the signal processors 126, as 
described above) to the memory system 122 to retrieve and analyze 
signal G102. The signal analyzer produces a video signal with a 

20 standard size of 320 x 200 pixels and metadata. The output of the signal 

analyzer is stored in data buffer 124m and is assigned global 
identification code GUI. 

xii. Couple a video scaler 160f to memory system 122 to retrieve signal 
GUI and produce a 440 x 140 pixel scaled version of signal G1 1 1 . The 

25 scaled version is stored in data buffer 124n and is assigned global 

identification code G112. 

[0059] During the operation of input processor 104, successive packets of each 
signal stored in a data buffer 124 are stored in the data buffer and previously stored 
30 packets are read out and then discarded. Some signals, such as input signal 110a 
are read by more than one device. Input signal 1 10a. identified by its global 
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identification code G101, is read out by video scalers 160a and 160b. The data buffer 
124a in wliich input signal 110a is buffered is configured to discard each packet in the 
input signal only after the packet has been read by both of the video scalers. 
[0060] Signals G105 - G1 10 and G1 12 are required to produce the output 
5 signals 114 for video monitors 116. These signals are combined into packetized 
signal 112 using packetized signal formatter 128, packetized signal buffer 130 and 
packetized signal generator 132. The signals that are used to produce a packetized 
signal 112 are referred to herein as packet source signals for that packetized signal. 
[0061] Reference is next made to Figure 5, which illustrates the format of the 
10 packetized signal 112. In the present embodiment, the packetized signal 112 
comprises a series of packets 190, each of which contains the following fields: 

I. global identification code for the signal from the data in the packet was 

obtained; 
ii. packet ordering information; 
15 iii. a data payload; 

Iv. optional error detection and correction information and other metadata. 
[0062] The packet ordering information, which may comprise a sequential 
packet number for each packet with the same global identification code, allows 
packets derived from the same packet source signal to be isolated from other 
20 packets, allowing the data in the packet source signal or a version of the data in the 
packet source signal to be re-assembled in the output processor 106, as is 
described below. 

[0063] In addition to packet ordering information, a video data packet may 
optionally also include frame ordering information, identifying the particular frame of 
25 video signal to which the packet corresponds. 

[0064] The content and format of the data payload in each packet 190 will 
depend on the type of the data contained in the packet. 

[0065] For example, if a packet source signal comprises a stream of data that 
is not organized as packets of information, then each packet 190 formed from that 
30 packet source signal contains a fixed amount of data in the data payload field. For 
example, if a packet source signal is a continuous stream of video data, then each 
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corresponding packet 190 contains upto 320 bytes of the video data. In other 
embodiments, the amount of data in a particular packet may be fixed at a different size 
or may be variable. 

[0066] If a packet source signal is organized as a series of packets of 
5 information, as in case of MPEG-2 encoded video or MP3 encoded audio or AES 
encoded audio, then the data payload may comprise the entire packet from the packet 
source signal. , 
[0067] Referring to Figure 3, video window 170 is a 400 x 300 pixel window in 
which signal G105 will be displayed. Signal G105 is created by video scaler 160a in a 

10 digital video standard that comprises a stream of video data that is not separated into 
packets. If each pixel in the 400 x 300 pixel window 170 requires one byte of video 
data from signal 01 05, then an entire frame of video information for the window 
requires 120,000 bytes of data. If the standard according to which the signal is 
encoded provides that one complete horizontal line of information will be encoded in a 

15 single packet, then each frame will be encoded in 300 packets in data buffer 124f. 
[0068] Packet signal formatter 128 retrieves the successive packets in data 
buffer 124f that encode each frame of video signal G105 and produces a series of 
packets 190 that correspond to the retrieved packets. In the following discussion, 
pixel numbers are set out as n,m where n is the number of the pixel in a window in a 

20 horizontal line of a window or frame and m is the number of the line in the window or 
frame. Pixels and lines are numbered starting at 1. The packets 190 corresponding 
to one frame of the 400 x 300 pixel window include pixel data for the following ranges 
of pixels: 



Packet 


Pixel range 


1 


1,1 -320,1 


2 


321,1 -240,2 (i.e. pixels 321-400 on 
line 1 and pixels 1-240 on line 2) 


3 


241,2-160,3 


4 


161,3-80,4 


5 


81,4-400,4 
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6 


1,5-320,6 


• 
• 


• 
• 


373 


241,298 - 160,299 


374 


161,299 - 80,300 


375 


81,300-400,300 



[0069] Similarly, the packetized signal formatter reads the successive packets 
in data buffer 124h that encode each frame of video signal G107 and produces a 
series of packets 190. The packets 190 corresponding to one frame of the 200 x 1 13 
5 pixel window include pixel data for the following ranges of pixels: 



Packet 


Pixel range 


1 


1,1 -120,2 


2 


121,2-40,4 


3 


41,4-160,5 


• 
• 
• 


• 
• 
• 


70 


81,111 -300,112 


71 


1,113-200.113 



[0070] The last packet 190 used to packetize each frame of video signal G107 
contains data for only 200 pixels. The remaining data space is filled with Null 
characters by the packetized signal formatter 128. Alternatively, the last packet may 

10 have a shortened data payload length. 

[0071] The packetized signal formatter 128 produces packets 190 
corresponding to the data in the packet source signals. Depending on the data 
formats used for the packet source signals, the packetized signal formatter 128 may 
produce one or more packets 190 that correspond to the data in one packet of a 

15 packet source signal. For example, if packet source signal G105 is encoded using a 
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digital video standard that includes a complete frame of video in a single packet, then 
the packetized signal formatter 128 will produce 375 packets 190 corresponding to 
each packet in the packet source signal. 

[0072] A single packet 190 may correspond to data from more than one packet 
5 of a packet source signal. For example, if packet source signal G107 is encoded 
using a digital video standard that encodes a single line of a frame in each packet, 
then the packetized signal formatter will generate packets 190 corresponding to more 
than one packet in the packet source signal, since each of the packets 190 can 
contain data for 320 pixels and since each line in packet source signal G107 is only 

1 0 200 pixels wide. 

[0073] The packetized signal formatter 128 proceeds to generate packets 190 
for each of the packet source signals for the packetized signal 112, as packets from 
the packet source signals are available from the corresponding data buffers 124. As 
packetized signal formatter 128 produces packets 190, it stores them in packetized 

15 signal buffer 130. Packetized signal buffer 130 is a data buffer and may include 
memory space in memory system 122. 

[0074] Packetized signal generator 132 retrieves the packets 190 stored in 
packetized signal buffer 130 and generates packetized signal 112 at packetized 
signal output port 138. Packetized signal 112 may be a synchronous signal. For 

20 example, in the present embodiment, the packetized signal is a synchronous signal 
transmitted at 2.5 Gbits/second. Referring to Figure 5, if there are no packets 190 in 
the packetized signal buffer 130, the packetized signal generator transmits null 
characters 192 between packets. In other embodiments, the packetized signal 
generator may transmit the packetized signal 1 12 at any bit rate, depending on 

25 requirements and capabilities of the system 100. 

[0075] Reference is made to Figure 1 . In the present embodiment, the 
packetized signal output port 112 will typically be coupled to the output processor 
(Figure 1) through a communication link 186, which may be a data cable such as an 
electrical or optical cable. The data rate and other aspects of the data protocol used 

30 to transmit the packetized signal 1 12 correspond to the ability of the communication 
link 186. 
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[0076] In other alternative embodiments, the packetized signal generator 128 
may transmit the buffered packets 190 as an asynchronous stream of packets to the 
output processor using any communication protocol, including TCP/IP. In this case, 
the communication link 186 may be a cable or may be a^LAN, WAN, the Internet or 
5 another communication system. 

[0077] Reference is next made to Figure 6, which illustrates the output 
processor 106. The output processor 106 has a packetized signal input port 202, a 
packetized signal input stage, a memory system 208, a plurality of signal processor 
210, an output signal generator 212, a bank 213 of digital-to-analog (D/A) converters 

10 215, a plurality of output ports 214 and one or more local signal generators 224. Each 
packetized signal input stage 205 comprises a packetized signal input buffer 204, a 
packetized signal extractor 206. The display devices 116 are coupled to the output 
ports 210. The output processor 106 also includes an output processor local 
controller 216 that receives output processor control signals 121 from the master 

15 controller 102 (Figure 1). The output processor local controller 216 is coupled to the 
various components of the output controller 106 through control lines 218 and 
controls the operation of those components in response to the output processor 
control signals 121. 

[0078] Memory system 208 includes a plurality of data buffers 220. 
20 [0079] The output processor control signals 121 received by the output 
processor local controller 216 indicate: 

i. which signals (by their global identification codes) are required for each 
output signal 114; and 

ii. the fomnat of each output signal 1 14 and, if the output signal is a video 
25 signal, the layout of the display Including the position and dimensions of 

each window on the display, in accordance with the user control signals 
(Figure 1). 

[0080] In the present embodiment, the output processor local controller 216 
translates each global identification code into a local identification code. 
30 [0081] The packetized signal 112 is received at input port 202 and is buffered in 
packetized stream input buffer 204. As complete packets 190 are stored in buffer 204, 
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there are retrieved by packetized signal extractor 206. The packetized signal extractor 
206 determines the global identification code of each packet, translates the global 
identification code into the corresponding local identification code assigned by output 
processor local controller and stores packets 190 corresponding to each local 
5 identification code in a different data buffer 220. Through this process, the data from 
each source signal for the packetized signal is isolated in a different data buffer 220. 
Each isolated signal corresponds to one of the packet source signals for the 
packetized signal. The packet ordering information from each packet 190 is used to 
organize the packets 190 into their original sequence. Each isolated signal is 

10 referred to herein as an output source signal. 

[0082] The local identification codes are used within the output processor 106 
in place of the global identification code to distinguish between the different local 
source signals encoded in the packetized signal. In alternative embodiments, the 
global identification code may be used to identify the different local source signals 

15 within the output processor 106. 

[0083] The signal processors 210 may be used to reverse any compression or 
other signal processing operation applied in the input processor 104 (Figure 2) using 
the signal processors 126. Depending on the signal processing operations 
performed in the input processor 106, a reversing step may or may not be required. 

20 For example, if one of the input signals 110 was compressed using a standard 

compression format that may be directly used to produce an output signal 114, then it 
is not necessary to reverse the compression. However, if the result of the 
compression step produced data that cannot be directly used to produce an output 
signal 114, then a decompressor may be used to reverse the compression step. For 

25 example, one of the signal processor described above was a horizontal line filter, 
which compresses an input video signal 1 10 by discarding a portion of the video 
signal. This compression step may be reversed by interpolating the discarded data 
from the retained data. The resulting processed signal 222 is stored in a data buffer 
as an output source signal and is assigned a unique local identification code by the 

30 output processor local controller 216. 
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[0084] In addition to reversing signal processing operations applied in the input 
processor, a signal processor 210 may be used to apply any other signal processing 
operations to a signal buffered in a data buffer 220 to produce an output source 
signal. 

5 [0085] Reference is made to Figure 3. Graphics display window 178 on video 
monitor 116a contains a display of the current date, time and warning messages 
based on metadata extracted from the input packetized signal received with global 
identification code G111. The date and time information is generated by a local signal 
generator 224a, which operates under the control of the output processor local 

10 controller. Each local signal generator 224 produces an output source signal 

containing infomiation and formatted for the use in an output signal. In this example, 
the local signal generator 224a generates a 200 x 150 pixel window containing the 
date and time. The output processor 106 may include other local signal generators 
224 that produce other video, audio or data signals for inclusion in the output signals. 

15 In each case, the signal produced by the local signal generator is stored in a separate 
data buffer 220 and is assigned a local identification code. The metadata maybe 
generated using a signal analyzer among the signal processors 210. The metadata 
produced by the signal analyzer is combined with the data and time information by a 
video signal generator in the output signal generator 212. Similar metadata could 

20 also be generated in the input processor 104 (Figure 1) using a signal processor 
126. 

[0086] The output signal generator 212 can generate a variety of digital output 
signals that may be used directly, or after conversion through a D/A converter 215, by 
output device 116. The output signal generator 212 may include one or more digital 

25 video signal generators, one or more digital audio signal generators or one or more 
data signal generators or any combination of video, audio and data signal generators. 
The data signal generators may include TCP/IP signal generators that produce an 
output signal 114 suitable for transmission using a communications link to a remote 
computer system, where the output signal may be decoded and used by a video, 

30 audio or data system. Similarly, the data signal generators may generator signals in 
any data format. 
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[0087] The output signal generator 212 extracts the data required for each 
output signal 114 from the appropriate data buffers 220 and generates the output 
signal 114. For example, a video output signal generator receives instructions from 
the output processor local controller 216 identifying the output source signals (by their 
5 local identification code and the data buffer 220 in which they are buffered) required 
for an output signal, the layout of the output video signal in terms of the position and 
dimensions of each window, and the output source signal for each window. The 
video output signal generator extracts the video information for each frame from the 
corresponding data buffers 220 and generates each frame for the output signal 114. 

10 If the video signal includes audio components, these audio components are similarly 
retrieved as output source signals and added to the output video signal 1 14. 
[0088] Similarly, the audio and data output signal generators retrieve the output 
source signals from the appropriate buffers and produce their output signals. 
[0089] If the device coupled to a particular output port 214 requires an analog 

15 output signal, then one of the D/A converters 215 may be dynamically coupled 
between the output signal generator and the output port 214 to convert the digital 
output signal into a corresponding analog output signal. 
[0090] To produce the video signals for the example output video monitors 
116a (Figure 3) and 116b (Figure 4), the output processor local controller configures 

20 the output controller to operate as follows: 

i. Packetized signal extractor 206 operates as follows: 

a. Extract signal G105 from the packetized signal 112 stored in 
packetized stream input buffer 204, assign it local identification 
code B201 and store it as an output source signal in data buffer 

25 220a; 

b. Extract signal G106 from the packetized signal 112 stored in 
packetized stream input buffer 204, assign it local identification 
code B202 and store it as an output source signal in data buffer 
220b; 

30 c. Extract signal G107 from the packetized signal 112 stored in 

packetized stream input buffer 204, assign it local identification 
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code B203 and store it as an output source signal in data buffer 

220c; 

d. Extract signal G1 08 from the packetized signal 1 1 2 stored in 
packetlzed stream input buffer 204, assign it local identification 

5 code B204 and store it as an output source signal in data buffer 

220d; 

e. Extract signal G109 from the packetized signal 112 stored in 
packetized stream input buffer 204, assign it local identification 
code B205 and store it as an output source signal in data buffer 

10 220e; 

f. Extract signal G1 1 0 from the packetized signal 112 stored in 
packetized stream input buffer 204, assign it local identification 
code B206 and store it as an output source signal in data buffer 
220f; and 

15 g. Extract signal G1 12 from the packetized signal 1 12 stored In 

packetized stream input buffer 204, assign it local identification 
code B207 and store it as an output source signal in data buffer 
220g. 

ii. Local signal generator 224 produces a 200 x 150 pixel data and time 
20 window as described above. Assign local identification code B208 to 

this signal and store It as an output source signal in data buffer 220h. 
ill. Output signal generator 212 generates two output signals as follows: 

a. One output video signal generator 212a extracts local signals 
B201, B203, B205, B207 and B208 from the conresponding data 

25 buffers 220 and produces an output signal 114a. 

b. A second output video signal generator 212b extracts local 
signals B202 B204 and B206 from the corresponding data buffers 
220 and produces an output signal 114b. 

iv. A D/A converter is coupled between video signal generator 212a and 
30 output terminal to convert output signal 1 14a into a digital output signal, 

which is then displayed by video monitor 1 16a. 
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V. Output signal 114b is coupled directly to output port 214b. Video monitor 
116b receives and displays the digital output signal 114b. 
[0091] Referring to Figure 1, the input processor 102 receives a plurality of 
different input signals 110, which are asynchronous with respect to one another to be 
5 received at the input processor. The input signals are processed using signal 

processor 126 to put them into a format that is required for the output signals 114 and 
resulting processed signal (the packet source signals) are combined into a single 
packetized signal 112. If an input signal 110 does not require any processing to be 
used as part of an output signal, the output signal 110 may be a packet source signal. 

10 The input processor allows a plurality of asynchronous data signals 110, which may 
include video, audio and data signals, to be combined into a single packetized signal 
that may be transmitted using a single communication link 186. 
[0092] The output processor 106 receives the packetized signal 112 and 
isolates the different packet source signals and stores them in buffers 220 as output 

15 source signals. Local signal processor 210 in the output processor 106 may be used 
to reverse any signal processing operation performed in the input processor, if 
necessary or desired, to produce the output source signals. In addition, local signal 
generators 224 in the output processor 106 may be used to produce additional output 
source signals. One or more of the output source signals is used by a set of output 

20 signal generators 212 produce output signals 214. If necessary, a D/A converter may 
dynamically be coupled between an output signal generator and an output port to 
convert the corresponding output signal into an analog form. 
[0093] Together, the input processor 104 and output processor 106 allow a 
plurality of input signals to be transported from the input ports 108, combined in a 

25 manner controlled by a user through the user controller 118 and then provided in the 
final combined manner to the output devices 116. The input processor 104 and 
output processor 106 are coupled together using a single communication link 186, 
eliminating the need to couple each of the input signals separately to the output 
processor 106. 

30 [0094] In the embodiment of Figures 1 to 6, the input processor 104 includes 
video scalers 160 to scale video input signals 110 from their original dimension to 
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other dimensions required for the output signals 114. In some cases, this may 
required that the input video signal may be expanded to large dimensions, resulting in 
a packet source signal that requires a larger portion of the packetized signal 
bandwidth to transmit than the original input signal 110. To reduce this increased 
5 usage of bandwidth, another embodiment of the invention may be configured to 
ensure that the scalers 160 in the input processor 104 are only used to reduce an 
input signal 160 to smaller dimensions. Video scalers may be included in the output 
processor as signal processors 220 to scale any input signal that must be enlarged 
before it is incorporated into an output signal. 

10 [0095] Reference Is next made to Figure 7, which illustrates a second input 
processor 304. Input processor 304 is similar to input processor 104 (Figure 2) and 
similar components are given similar reference numbers. The input processor local 
controller 340 is coupled to the various components of the input processor 304. 
These couplings are not illustrated to simplify the Figure. Input processor 304 has a 

16 plurality of packetized signal output stages 327, each of which comprises a 

packetized signal formatter 328, packetized signal buffer 330 and packetized signal 
generator 332. Each packetized signal output stage 327 is capable of generating a 
packetized signal 112. Each packetized signal 112 may include information any one 
or more of the input signals 110. Input processor 304 may be used to provide 

20 packetized signals to different output processors 106 (Figure 7). Each output 

processor can receive a packetized signal containing only information from packet 
source signals that are required to produce the output signals 114 produced by that 
specific output processor. 

[0096] The number of packet source signals (which are generally different 
25 versions of input signals 110) that can be transmitted in a single packetized signal 
may be limited by the amount of data in each signal and the bandwidth of the 
packetized signal. Particularly in the case of audio and video signals, which may be 
required to be received in real time at the output processor 106 in order to be properly 
displayed on an output device 116. Input processor 304 allows each input source 
30 108 to be coupled to a single input port on a single input processor and then be 
combined in different combinations for transmission to different output processors 
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106. In one embodiment, an input processor includes four output stages to provide 
four packetized signals 1 12, which may be coupled to four different output processors 
106. 

[0097] Reference is next made to Figure 8, which illustrates a second output 
5 processor 403. Output processor 403 is similar to output processor 104 (Figure 6) 
and similar components are identified with similar reference numbers. Input 
processor 403 has a plurality of packetized signal input stages 405, each of which 
comprises a packetized signal input buffer 404 and a packetized signal extractor 406. 
Each input stage 405 receives a packetized signal 112 at a packetized signal input 

1 0 port 202 and stores the data for each source signal for each packetized signal in a 
separate data buffer in memory system 208. This allows output processor 403 to 
receive a larger number of source signal than could be transmitted in a single 
packetized signal. Output processor 403 operates in the same manner to further 
process and generate output signals 114, which may incorporate data from one or 

15 both of the packetized signals. 

[0098] Reference is next made to Figure 9, which illustrates three input 
processors 304 and two output processors 306. Input processor 304a receives eight 
input signals from eight sources 108a - 108h and generates two packetized signals 
112a and 112b. Input processor 304b receives eight input signals from eight sources 

20 1081 - 108p and generates two packetized signals 112c and 112d. Input processor 
304c receives eight input signals lOBq - lOBx and generates one packetized signal 
112e. Output processor 403a receive packetized signals 1 12a and 1 12c and 
produces four output signals 1 14a - 1 14d at output terminals 214a - 214d. These 
output signals may Include information from any of the sixteen input signals 108a - 

25 108p. Output processor 403b receives packetized signals 112b, 112d and 112e and 
produces four output signals 1 14e - 1 14h at terminals 214e - 214h. The output 
signals 114a - 114h may include information from any of the twenty-four input signals 
108a - 108x. In each case, each input source is coupled to only one input terminal, 
but may be combined with the other input sources in the output signals. 

30 [0099] A single packetized signal 112 produced by a input processor 104 or 
304 may be coupled to more than one output processor by first routing the packetized 
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signal 112 through a signal replicating device. For example, the packetized signal 
112 may be replicated using a cable driver with multiple duplicate outputs or other 
signal replication device and transmitted on multiple communications links to more 
than one output processor. 
5 [00100] Reference is next made to Figure 10, which illustrates a first packet 

router 502 coupled between a plurality of input processors 104 and 304 and a plurality 
of output processors 403. Each of the input processors produces one or more 
packetized signals 112 that are received by the packet router 502. Packet router 502 
includes a packet router controller 504, a plurality of packetized signal buffers 506, a 

10 plurality of packetized signal extractors 508, a plurality of data buffers 510 and a 
plurality of packetized link output stages. Packet router controller 504 controls the 
operation of packet router 502 through control lines 507, which couple the packet 
router controller 504 to the other elements of packet router 502 (connections are not 
shown to simplify the Figure). Each packetized signal 112 is buffered in a packetized 

15 signal buffer 506. As complete packets 190 of a packetized signal 112 arrive, a 
packetized signal extractor 508 determines the global identification code of each 
packet 190 and stores all packets 190 corresponding to the same global identification 
code in a single data buffer 510. The packetized signal extractor operates under the 
control of the packet router controller, which designates the particular data buffer in 

20 which the packets 190 having the same global identification code are stored. 
Through this process, all packets having the same global identification code are 
isolated in a data buffer. The actual content of the packets 190 is not altered. 
[00101] Each packetized signal output stage 527 includes a packet selector 528, 
a packetized signal buffer 530 and a packetized signal generator 532. The packet 

25 selector 528 operates under the control of the packet router controller 504 to extract 
packets 190 from one or more of the data buffers 510 and place them in packetized 
signal buffer 530. The packetized router controller receives packet router control 
instructions 520 from the master controller 102 to generate one or more packetized 
signals containing corresponding to a set of specified global identification codes. For 

30 each requested packetized signal, the packet router controller instructs the packet 
selector 528 in one of the packetized signal output stages 527 to extract packets from 
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the data buffers 510 corresponding to the specified global identification codes for that 
requested packetized signal. As the packets become available in the data buffers 
510, the packet selector 528 extracts them and stores them in the packetized signal 
buffer 530. Packetized signal generator 532 operates in the same manner as 
5 packetized signal generator 132 to generate a new packetized signal 512. 

[00102] Each packetized signal output stage 527 operates independently of the 
others. Any number of packetized signals 512 generated by the packetized signal 
output stages may include packets from the same data buffer 510 (corresponding to a 
particular global identification code). Each data buffer is operated to ensure that each 

1 0 packet in the data buffer are not discarded until each the packet has been read by 
every packetized signal output stage that requires the packet. 
[00103] Through this operation, the packet router receives a plurality of 
packetized signals 112 and generates a new set of packetized signals 512. The 
created packetized signals may comprise packets with any combination of global 

15 identification codes, allowing input signals received at different input processors to be 
combined in a single packetized signal 512 for delivery to an output processor 403. 
Each output processor may receive multiple packetized signals 512 from a packet 
router 502 and may also receive one or more packetized signals 112 directly from an 
input processor. 

20 [00104] Inserting packet router 502 between a plurality of input processors 104 
and 304 and output processors 104 and 403 allows an input signal 110 received at 
any one of the input processors to be routed (possibly after being processed in the 
input processor by signal processor 126) to any of the output processors for use by 
any of the output devices 1 16 coupled to an output processor. Each input signal is 

25 received In only one location, but may be used in multiple formats (by creating 

appropriate versions of the input signal using signal processor 126) at multiple output 
devices 116. 

[00105] Reference is next made to Figure 11, which illustrates a second packet 
router 602. Like packet router 502, packet router 602 receives one or more 
30 packetized signals 112 from one or more input processors, and provides one or more 
packetized signals 612 to one or more output processors. Packet router 602 includes 
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a packet router controller 604, a plurality of packetized signal buffers 606, a plurality of 
packetized signal extractors 608, a mennory system 609 including a plurality of packet 
storage locations 610 and a plurality of packetized signal output stages 627. Packet 
router controller 604 controls the operation of packet router 602 through control lines 
5 607. Packet router controller 604 uses the packet storage locations 610 to 
temporarily store packets 190 from the packetized signal 112. 
[00106] Each packetized signal 112 is buffered in a packetized signal buffer 606. 
As each complete packet 190 of a packetized signal 112 arrives, a packetized signal 
extractor 608 stores the complete packet 190 in one of the packet storage locations 

10 610. The packet router controller 604 maintains a storage location table 61 1 
indicating whether each packet storage location 610 is available to store a newly 
arrived packet. The packet router controller 604 selects an available packet storage 
location 610 and instructs the packetized signal extractor to store the newly arrived 
packet 190 in the selected packet storage location 610. The packet router controller 

15 604 then updates the storage location table 611 to indicate that the packet storage 
location 610 is not available to store another packet 190. 

[00107] The packet router controller 604 receives router control instructions 620 
(similar to the router control instructions 520 received by packet router controller 502 
(Figure 10)) from master controller 102 instructing the packet router controller to 

20 generate the packetized links 612 using packets 190 with specified global 

identification codes. The packet router controller 604 determines assigns one of the 
packetized signal output stage 527 to generate each of the required packetized 
signals 612 and maintains a global identification code distribution table 613 
correlating each global identification code with the packetized signal output stages 

25 627 that require the global identification code. For example, a specified global 

identification code G603 may be required for three of the outgoing packetized signals 
612. The three packetized signal output stage 627 used to generate those three 
packetized signals 612 are listed in the global identification code distribution table 
613 in association with global identification code G603. 

30 [00108] Each packetized signal output stage 627 includes a packet selector 628, 
a packetized signal buffer 630 and a packetized signal generator 632. Packet selector 



-33- 



628 reads packets 190 from the packet storage locations 610 as described below 
and stores the packets 190 in packetized signal buffer 630. Packetized signal buffer 
630 and packetized signal generator 632 operate in the same manner as packetized 
signal buffer 130 (Figure 2) and packetized signal generator 132 to produce the 
5 packets signals 612. 

[00109] In the storage location table 61 1, the router controller 604 maintains the 
status of each packet storage location 610 by recording the number of packetized link 
output stages 627 that must read a packet 190 stored in the packet storage location 
before the packet 190 may be discarded. In the present embodiment, when a newly 

10 received packet 190 is stored in a free packet storage location 610, the router 

controller records the number of packetized signal output stages 627 that require the 
packet 190 to generate a packetized signal 612. The router controller 604 then 
instructs each of the packetized signal output stages 627 to read the packet 190 from 
the packet storage location 610. The packet selector 628 in each packetized signal 

15 output stage reads the packet from the packet storage location 610 and indicates to 
the router controller 604 that it has done so. The router controller 604 than 
decrements the number of packetized signal output stages 627 that still require the 
packet in that packet storage location 610. When each of the packetized signal output 
stages 627 that require the packet 190 have indicated that they have read the packet 

20 190, the packet is no longer required (i.e. the number of packetized signal output 
stages still requiring the packet 190 is zero), and the router controller 604 treats the 
packet storage location 610 as free. 

[00110] For example, each packet 190 with global identification code G603 may 
be required by packetized signal output stages 627a. 627c and 627d to produce 

25 outgoing packetized signal 612a, 612c and 612d. When a complete packet 190 with 
global identification code G603 is received, router controller 604 selects a free packet 
storage location 610b and instructs the appropriate packetized signal extractor 508 to 
store the packet 190 in packet storage location 610b. The router controller 604 then 
sets the status of packet storage location 610b to "3", indicating that the packet 190 

30 must still be read by three packetized signal output stages. The router controller than 
instructs packetized signal output stages 627a, 627c and 627d to read the packet 
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190. Each of packet selectors 628a, 628c and 628d reads the packet 190 and 
indicates to router controller 604 that it has done so. Router controller 604 
decrements the status of the packet storage location 610b as it receives each 
indication and when the status returns to "0", the packet storage location 610b is 
5 again free to store another packet 190. 

[00111] Reference is next made to Figure 12, which illustrates a third packet 
router 702. Packet router 702 is similar in structure and operation to packet router 
602 and similar components are identified with similar reference numbers, increase 
by one hundred. Packet router 702 has a plurality of signals processors 726 coupled 

10 to memory system 709. Signal processor 726 operate In a similar manner to signal 
processors 210 (Figure 6) under the control of router controller 704. Router controller 
704 receives instructions from master controller 102 to perform one or more signal 
processing steps on the signal encoded with a particular global Identification code. 
For example, the master controller may indicate that a video signal with global 

15 identification code G734 must be scaled to dimensions of 800 x 600 pixels and the 
resulting processed signal is to be assigned global identification code G783 and 
must be included in packetized signals 712b and 712c. Router controller 704 then 
configures the global identification code distribution table 713 to route packets with 
global identification code G734 to a video scaler 760 among the signal processors 

20 726. The router controller 704 may also route the same packet to one or more other 
signal processors 726 or packetized signal output stages 727. The video scaler 760 
is configured to perform the video scaling operation and produces packets 190 
identified with global identification code G783. These packets are stored in free 
packet storage locations as designated by the router controller 702. The packets are 

25 then distributed to packetized signal output stages 727b and 727c using global 
identification code distribution table 713 and storage location table 711. 
[00112] Reference is next made to Figure 13, which illustrates an output stage 
827 for an output processor. Output stage 827 may be used for video output signals 
and includes a buffer 840 coupled to output signal generator 212 and an output 

30 terminal 842. The output signal 1 14 generated by the output signal generator 212 is 
stored in data buffer 840. The stored signal is extracted from the data buffer 840 by a 
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local output generator 832 which makes the output signal 1 14 available at an output 
terminal 214. Optionally a D/A converter may be coupled between the local output 
generator 842 and output terminal 214 to convert the output signal into a 
corresponding analog output signal for use by an analog device coupled to terminal 
5 214. 

[00113] The buffered stream is also extracted from the data buffer 840 by a 
remote output generator 844, which packetizes the video output signal 114 into a 
graphics packet stream 846. Each packet in the graphics packet signal 846 contains 
video data for a fixed number of pixels in the output signal 1 14. Each packet has the 
10 following fields: 

i. packet ordering information, such as video positioning information 
indicating the first pixel at which the video data is to be displayed; and 

ii. the video data. 

[00114] Each packet may also contain additional metadata including error 
15 correction and detection information, frame numbering information and other 
information. 

[00115] The graphics packet signal 846 is transmitted to a graphics packet 
signal ports 848, from which it may be transmitted across a communication link 850 
to display interface 852 capable of receiving the graphics packet signal 846, 
20 reconstructing the output signal 114 and displaying the output signal on a display 
monitor 116. 

[00116] Output stage 827 allows an output signal 114 to be replicated on two 
different display monitors. The output signal 1 14 may be replicated on any number of 
display monitors by providing a remote output generator for each such monitor. 

25 [00117] Reference is next made to Figure 14, which illustrates a switch 860 

coupled between a plurality of graphics packet signal ports 848, which may be part of 
one or more output stage 827 in one or more output processors, and a plurality of 
display interfaces 852. The switch 860 may be implemented as a physical switch, 
which may be manually operable or automatically operable under the control of the 

30 master controller 102 (not shown in Figure 12). The switch 860 may be implemented 
using a field-programmable gate array (FPGA) or with any other switching or packet 
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routing technology. Switch 860 allows any of the graphics packet signal ports 848 to 
be coupled to any display interface 852, allows any of the input signals 114 available 
at any of the graphics packet signal ports 848 to be displayed at any display monitor 
coupled to a display adapter 852. 
5 [001 18] The present Invention has been described here by way of example only. 
Various modification and variations may be made to these exemplary embodiments 
without departing from the spirit and scope of the invention, which is limited only by 
the appended claims. 
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